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SPECIFICATION 

DOCUMENT REVIEW APPARATUS, A DOCUMENT REVIEW SYSTEM, AND 
A COMPUTER PRODUCT 




TECHNICAL FIELD 

This invention relates to a document review apparatus 
and a document review system for reviewing documents by using 
a network. This also invention relates to a 

10 computer-readable recording medium in which programs for 
allowing a computer having a communication function to 
operate as such a document review apparatus are stored in. 

BACKGROUND ART 

15 Following recent advances in communication technology, 

there have been frequent attempts to process office work, 
performed by distributing printed materials through the post 
and the like, by transmitting and receiving electronic 
documents via a network. For example, Japanese Patent 

20 Application Laid-Open (JP-A) No. 8-147381 discloses a review 
work support system for electronically processing reviews 
and approvals, relating to financial check documents in the 
financial business and the like, by using a network. 
Furthermore, Japanese Patent Application Laid-Open (JP-A) 

25 No. 8-46637 proposes an electronic mail forward processing 



2 



method for realizing monitoring of documents by electronic 
mail . 

Moreover, Japanese Patent Application Laid-Open 
(JP-A) No. 7-200552 disclose a j oint document creation system 
5 for creating one document by aligning a plurality of 
computers which are connected by a communication network. 

By using the technology described in the above patent 
applications, various types of processes and operations can 
be efficiently and reliably performed. For example, there 

10 is an operation which is generally termed "document review" 
which is performed in manufacturing and the like . A document 
review is used in publishing and correcting documents and 
the like relating to specifications and the like, and 
comprises firstly creating (revising) a document to be 

15 reviewed by using a wordproce ssor or the like . Furthermore , 
a report describing the route and purpose for publishing 
(correcting) the document is created. As shown 

schematically in Fig. 19, copies of the report are 
distributed by mail to relevant departments. The 

20 departments, which the copies have been distributed to, 
review the contents of the copies and send their replies 
regarding the document review to the creator of the document 
(review instigator). The review instigator analyzes the 
received multiple replies and revises the document based 

25 on the result of this analysis, thereby producing the 



# m 



official document . 

By applying the technology described in the above 
patent applications to the part of this document review where 
mail is used, the document review can be carried out by 
5 rapidly. 

However, the system of such a constitution is nothing 
more than a system in which the time required for receiving 
written articles (documents) is electronically shortened. 
Therefore, there is a demand for a system which can 

10 efficiently realize document reviews. 

Therefore, it is a first object of this invention to 
provide a document review apparatus which can construct a 
network system for carrying out document reviews with extreme 
efficiency, and a computer-readable recording medium which 

15 programs for allowing a computer to operate as the document 
review apparatus are stored in. 

Furthermore, it is a second object of this invention 
to provide a document review system wherein document reviews 
can be carried out with extreme efficiency in a plurality 

20 of apparatuses which are connected via a network. 

DISCLOSURE OF THE INVENTION 

The document review apparatus according to one aspect 
of this invention comprises a communication unit connected 
2 5 to a network for performing communication with other devices ; 
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a memory unit; a determination unit which determines, based 
on information received from said communication unit/ 
whether the information is information holding a review 
result of a reviewed form to be reviewed; a storing control 
5 unit which stores information, which has been determined 
by the determination unit to be information holding a review 
result of a reviewed form, as review result information in 
said memory unit; and a creating unit which creates a single 
review result information based on the review result 

10 information when a predetermined number of review result 
informations have been stored in said memory unit. 

The document review apparatus according to the 
above-mentioned aspect has a function for collecting review 
result information which holds a review result relating to 

15 a reviewed form via the network, and a function for creating 
a single review result information from the collected review 
result informations. Therefore, when the document review 
apparatus is connected to the network, it can review 
documents with extreme efficiency, shortening not only the 

20 time required to receive the document which the review result 
is written in, but also the time required to analyze the 
document . 

The document review apparatus according to another 
aspect of this invention comprises a communication unit 
25 connected to a network for performing communication with 
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other devices; a first memory unit which stores a reviewed 
form which is to be reviewed by a plurality of reviewers; 
a second memory unit; a determination unit which determines, 
based on information received from said communication unit, 
5 whether the information is information holding a review 
result of a reviewed form to be reviewed; a storing control 
unit which stores information, which has been determined 
by the determination unit to be information holding a review 
result of a reviewed form, as review result information in 

10 said second memory unit; a creating unit which creates 
statistical data relating to the review result information 
when a predetermined number of review result information 
from the plurality of reviewers have been stored in said 
second memory unit; and an updating unit which updates the 

15 contents of the reviewed form stored in said first memory 
unit by using the statistical data created by said creating 
unit . 

The document review apparatus according to the 
above-mentioned aspect has a function for collecting review 

20 result information which holds a review result relating to 
a reviewed form via the network, a function for creating 
statistical data by statistically processing the collected 
review result information, and a function for updating the 
contents of the reviewed form by using the created 

25 statistical data. Therefore, when the document review 



apparatus is connected to the network, it can perform 
extremely efficient document review, shortening not only 
the time required to receive a document which the review 
result is written in, but also the time required to analyze 
5 the document . 

The document review apparatus may further comprise 
a notification unit which notifies the plurality of reviewers 
that a reviewed form to be reviewed is stored in said first 
memory unit; and a transmission unit which, when information 

10 having a predetermined format and comprising address 
information has been received by said communication unit, 
uses said communication unit to transmit information which 
corresponds to the reviewed form stored in said first memory 
unit to a device identified by said address information. 

15 When the document review apparatus having this 

constitution is connected to the network, the document review 
can be completed by some of the reviewers (e.g. reviewers 
who are not directly involved in authorizing the contents 
of the reviewed form) without extracting the reviewed form 

20 through the internet. This is because the reviewers who 
are not directly involved in authorizing the contents of 
the reviewed form receive not i f i cat ion from the noti f i cat ion 
unit, and are able to transmit the review result information . 
As a result, when using the document review apparatus of 

25 this invention, the document review can be carried out with 
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efficient use of limited network resources. 

The document review apparatus may further comprise 
a display unit for displaying textual information, and an 
input unit for inputting commands. The updating unit 
5 comprises a display control unit which allows said display 
unit to display the contents of the reviewed form stored 
in said first memory unit in a format enabling an update 
result using statistical data created by said creating unit 
to be understood; and a contents updating unit which updates 

10 the contents of the reviewed form stored in said first memory 
unit based on a command which is input via said input unit 
while said display control unit is controlling the display. 
Moreover, in the case where the display unit is added, the 
document review apparatus according to the second aspect 

15 of this invention can be realized by adding a second display 
control unit which allows said display unit to display a 
graph based on the statistical data created by said creating 
unit . 

That is, the constitution of the document review 
20 apparatus may be such that the reviewed form is not completely 
revised automatically, but by dialog after confirmation from 
the operator. Then, to simplify the confirmation operation, 
the document review apparatus may be configured to display 
a graph showing the contents of statistical data of the review 
25 result information. 
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When a plurality of the document review apparatuses 
of this invention are connected together via a network to 
construct a system, it is possible to obtain a document review 
system wherein extremely efficient document review is 
5 performed by the document review apparatuses. 

Of course, the document review apparatus according 
to this invention can be configured (realized) as a special 
apparatus, but it can also be realized by storing programs 
for allowing a computer to operate as a document review 
10 apparatus having the functions described above in a 
computer-readable recording medium . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic diagram showing the constitution 

15 of a document review system constructed by using the document 
review apparatus according to an embodiment of this 
invention; Fig . 2 is a diagram showing a reviewer information 
table which is held by the document review apparatus 
according to the embodiment; Fig. 3 is a diagram showing 

20 a review request form which is prepared in the document review 
apparatus according to this embodiment; Fig. 4 is a diagram 
showing a response format which is prepared in the document 
review apparatus; Fig. 5 is a flowchart showing operating 
procedures (as far as transmitting a document review request 

25 mail) of the document review apparatus according to this 
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embodiment; Fig. 6 is a diagram showing a reviewed form which 
is displayed on a display of a reviewer terminal and the 
like; Fig. 7 is a flowchart showing an example of operating 
procedures performed in a reviewer terminal which has 
5 received the document review request mail ; Fig . 8 is a diagram 
showing a correction form file which is created in the 
reviewer terminal by using the reviewed form extracted from 
the document review apparatus; Fig. 9 is a diagram showing 
a correction response form which is created in the reviewer 

10 terminal by using the response format extracted from the 
document review apparatus; Fig. 10 is a flowchart showing 
operating procedures of the document review apparatus 
according to this embodiment in the case where an e-mail 
has been received during execution of document review 

15 processing; Fig. 1 1 is a flowchart showing demand processing 
performed as part of the document review processing; Fig. 
12 is a continuation of the flowchart of Fig. 10 and shows 
operating procedures of the document review apparatus 
according to this embodiment; Fig. 13 is a diagram showing 

20 a correction required phrase table created by the document 
review apparatus according to this embodiment; Fig. 14 is 
a continuation of the flowchart of Fig . 12 and shows operating 
procedures of the document review apparatus according to 
this embodiment; Fig. 15 is a diagram showing a constituent 

25 element of a screen for reviewed form revision, which is 



displayed by the document review apparatus of this embodiment , 
and comprises a reviewed form revision region; Fig. 16 is 
a graph used as a constituent element of the screen for 
reviewed form revision which is displayed by the document 
5 review apparatus of this embodiment; Fig. 17 is a graph used 
as a constituent element of the screen for reviewed form 
revision which is displayed by the document review apparatus 
of this embodiment ; Fig. 1 8 is a continuation of the flowchart 
of Fig. 14, and shows operating procedures of the document 
10 review apparatus according to this embodiment; and Fig. 19 
is a schematic diagram showing contents of a document review 
operation . 



BEST MODE FOR CARRYING OUT THE INVENTION 

15 The invention will be explained in detail based on 

the accompanying drawings . 

The document review apparatus according to this 
invention is an apparatus for carrying out a document review 
relating to a published and corrected document such as a 

20 stipulation. As shown schematically in Fig . 1, the document 
review apparatus 10 according to an embodiment of this 
invention is connected via a network to a plurality of 
reviewer terminals 20, comprising terminals used by 
reviewers. The document review apparatus 10 comprises 

25 several programs added to a computer which can be used as 
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a WWW server. Therefore, the hardware constitution of the 
apparatus will not be explained. 

In using the document review apparatus 10 to review 
a document, the operator prepares a reviewer information 
5 table (not shown) , a reviewed form, a review request form, 
a response format, and a demand form (not shown) in a memory 
apparatus 11 of the document review apparatus 10. 

The reviewer information table is a table which holds 
information relating to the reviewer. As shown in Fig. 2, 

10 the reviewer information table sets e-mail (electronic mail ) 
addresses and review weight classes in correspondence with 
the names (department name and representative name) of the 
reviewers (review section) . 

A reviewed form is an electronic document such as a 

15 published or corrected stipulation which is to be the sub j ect 
of a document review. The reviewed form will be explained 
in more detail later. A review request form is an electronic 
document used as the content of a document review request 
mail which is sent to the reviewers. As shown in Fig. 3, 

20 the document review request form comprises a deadline and 
a URL (uniform resource locator) . A response format is an 
electronic document comprising a portion showing reasons 
and the like for publication and correction of the reviewed 
form, and a portion which is used by the reviewer as a model 

25 for writing (inputting via a keyboard) the review result. 
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Fig . 4 shows an example of the response form which is prepared. 
The demand form is an electronic document comprising contents 
of a demand mail which is sent in demand processing ( explained 
in detail later) to a reviewer who has not responded to the 
5 re view re quest. 

The review request form, the response format, and the 
demand form are prepared each time a new reviewed form is 
generated (for each document review), but the reviewer 
information table is not prepared for each document review. 
10 Usually, a reviewer information table which was prepared 
when the document review apparatus 10 started operating is 
used in each document review. The operator uses what is 
termed "editor software" to prepare the reviewed form and 
the like . 

15 After preparing the reviewed form and the like, the 

operator controls the document review apparatus 10 in a 
predetermined manner. The document review apparatus 10 
detects the predetermined control, and starts the processes 
shown in Figs. 5, 10 to 12, 14, and 18 (hereinafter termed 

20 "document review processing"). 

As shown in Fig. 5, the operator inputs the reviewed 
form identification information specifying the reviewed 
form, the deadline date , the URL, and the like, to the document 
review apparatus 10 (step S101) . The deadline date and URL 

25 which are input in this step are the same as those written 
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in the review request form. 

Thereafter, the document review apparatLL^ 10 appends 
phrase numbers to each phrase of each article comprising 
the reviewed form, specified by the inputz reviewed form 
5 identification information (stepS102) . jflext, the document 
review apparatus 10 registers the reviewed form and the 
response format in a WWW server (the Apparatus itself) so 
that reviewed form and the response/ format, which phrase 
numbers have been appended to, can Joe read by the URL input 

10 in step S101. That is, by performing an operation (browser 
activation and URL input) to an Apparatus comprising a web 
browser, a reviewed form, whictfphrase numbers are appended 
to, such as that shown in Fig/ 6, and the response format, 
such as that shown in Fig, 3, yean be displayed on the display 

15 of the apparatus. Incidei^ally , in Fig. 6, the numerals 
shown above the phrases comprising the articles are the 
phrase numbers appended/in step S102. 

Then, the document review apparatus 10 activates the 
demand process (step S104). The deadline date which was 

20 input in step S101 becomes information used in the demand 
process, as will be explained in detail later. 

After the demand process has been activated, the 
document review apparatus 10 transmits a document review 
request mail (hereinafter termed simply "request mail" ), 

25 comprising an e-mail of the contents of the review request 
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form (see Fig. 3), to the head of each department by using 
the e-mail address which is stored in the reviewer 
information table (see Fig. 2) (step S105) , and temporarily 
cancels the document review processing. That is, the 
5 document review apparatus 10 recognizes that the document 
review processing has been cancelled, and allows other 
processes to be executed. 

When the reviewer terminal 20 receives this request 
mail, the reviewer uses the software (e.g. browser software, 

10 mailer software) which is installed in the reviewer terminal 
20 to perform an operation for creating a response mail to 
■be sent in response to the document review apparatus 10. 

This operation is, for example, performed by the 
procedures shown in Fig. 7. 

15 That is, the reviewer confirms the existence of the 

form (reviewed form) which must be reviewed after receipt 
of the request mail. Using the URL written in the request 
mail, the reviewer refers to the contents of the reviewed 
form and the like stored in the document review apparatus 

20 10 and reviews the contents thereof (step S201) . Then, when 
it has been determined that correction is necessary (step 
S202 : YES) , the reviewer downloads the pages of the reviewed 
form which requires correction and the response format (step 
S203), and creates a correction form file which sets the 

25 original and the corrections (step S204). 
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The document review apparatus 10 treats a file such 
as that shown in Fig. 8 as a correction form file. For this 
reason, the reviewer extracts the required data (theoriginal 
form which requires correction and period numbers including 
5 the original) from the page data of the downloaded reviewed 
form. Then, the reviewer creates the correction form file 
by adding the correction form, comprising suggestions for 
corrections of phrase units, to the extracted data. 

Furthermore, based on the response format, the 

10 reviewer selects correction required, and creates a response 
form which sets the required information (step S205) . That 
is, the reviewer creates a response form in which need for 
correction is "2", such as that shown in Fig. 9, by using 
the later half of the response format shown in Fig. 4. 

15 Furthermore, when there are stipulations to be referred to 
when reading the document to be reviewed in addition to the 
stipulations which are written in the reviewed form relevant 
stipulation box (see Fig. 6), identification information 
for these is entered into the "reference stipulations" box. 

20 Moreover, when entries which conflict with ideas and 
stipulations are discovered in the reviewed form, phrase 
identifiers showing the existence of these entries and the 
names of the conflicting stipulations (clause number and 
the like) are written in the "conflicting stipulations" box. 

25 Furthermore, the reviewer writes his own evaluation (marked 
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out of 100) of the corrections in the corrected form file 
in the "evaluation of corrected form" box. 

Then, the reviewer transmits the response form which 
the information have been entered in as a file appended to 
5 an e-mail to the review request source (step S206) , whereby 
the operation ends. 

On the other hand, when the result of the review is 
that no correction is required (i.e. the original is 
adequate) (step S202; Yes), the reviewer downloads the 

10 response format (step S207) and creates a response form in 
which "correction not required" has been selected (by 
entering "1" in the correction required? box) by using the 
response format (step S208). Then, the reviewer e-mails 
the response form to the review request source (step S209) , 

15 and the operation ends. 

Incidentally, in a system using the document review 
apparatus 10 according to this embodiment, the operation 
of sending the response mail is performed by the reviewer. 
Therefore, the operating procedures of the reviewer are not 

20 limited to those shown in the diagrams. For example, the 
reviewer may carry out the review after downloading the 
reviewed form and the like. Alternatively, he may look at 
the response format (looking only at the portion which shows 
reasons for the publication and correction of the reviewed 

25 form) in step S101, and execute the processes from step S207 
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onwards . 

Subsequently, the operations of the document review 
apparatus 10 after sending the request mail and up to the 
completion of collecting the response mail will be explained . 
5 As already explained, after sending the request mail, 

the document review apparatus 10 is in a state of having 
confirmed that the document review processing is cancelled. 
When a receipt of e-mail is detected in this state, the 
document review apparatus 10 determines whether that e-mail 

10 is a response mail (step S301) . The document review 
apparatus 10 determines whether the e-mail is a response 
mail by checking the compatibility (whether the names match, 
etc.) between the content of the e-mail and the model 
contained in the response format. 

15 When the document review apparatus 10 has determined 

that the received e-mail is not a response mail (step S301: 
Yes), the document review apparatus 10 returns to a state 
of being able to execute other processes . On the other hand, 
when it has been determined that the e-mail is a response 

20 mail (step S301: No), the document review apparatus 10 
determines whether all the response mails have been received 
(step S302). That is, it is determined whether response 
mails have been obtained from all the reviewers whom request 
mails were sent to. 

25 Then, when all the response mails have not yet been 
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received (step S302: No) , the document review apparatus 10 

returns to a state of being able to execute other processes. 

On the other hand, when all the response mails have been 

received (step S302: Yes), the document review apparatus 
5 10 performs a process to stop the demand processing (step 

S303), and starts the processing shown in Fig. 12. 

Here, the demand processing will be explained. 

As shown in Fig. 11, the demand processing comprises 

transmitting a demand mail (step S402) to the department 
10 chiefs from whom response mails have not been received at 

timeout (step S401: Yes) , and resetting the time of the next 

timeout (step S403) . 

When the demand process is activated in step S104 (see 

Fig. 5), the document review apparatus 10 specifies the 
15 deadline date, which was input in step S 10 1 , as the time 

of the timeout. Furthermore, the time of the timeout is 

calculated in step S403 by adding a predetermined time (e.g. 

24 hours) to the time of the timeout which is presently set. 

As described above, the demand processing is stopped when 
20 the response mails have been completely collected. 

Consequently, when there is a reviewer who has not sent his 

response mail even though the deadline has expired, the 

document review apparatus 10 repeats the demand processing 

until the response mail is obtained. 
2 5 Subsequently, procedures for processing the collected 
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responses of the document review apparatus 10 will be 
explained . 

The document review apparatus 10 processes the 
responses by creating information (a type of database) in 
5 which the information written in the response is 
statistically arranged, and by revising the original based 
on the created information. 

To begin with, the operation of the document review 
apparatus 10 in carrying out the first of these processes 
10 will be explained based on Fig. 12. 

When response mails have been obtained from all the 
reviewer whom request mails were sent to (see Fig. 10) , the 
document review apparatus 10 deems the first phrase of the 
reviewed form to be a processing target phrase, as shown 
15 in Fig. 12 (step S320) . For example, when the reviewed form 
was the one shown in Fig. 6, the document review apparatus 
10 deems the phrase "Electronic" of the first paragraph 
having the phrase number (1) to be the processing target 
phrase . 

20 Then, the document review apparatus 10 reads the 

correction requirement data, information entered in the 
relevant stipulation box, and evaluation written in the 
evaluation box, from each response. In addition, the 
document review apparatus 10 reads the review weight classes 

25 allocated to the responses (step S321) . Subsequently, the 
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document review apparatus 10 retrieves information relating 
to the processing target phrases from the responses which 
indicate that correction is required (correction 
requirement data is "2") (step S322) . That is, the document 
5 review apparatus 10 retrieves information relating to the 
processing target phrases from the information written in 
the conflicting stipulation box, and also retrieves textual 
information (correction suggestions) provided in 
correspondence with the processing target phrase from the 
10 information written in the correction box of the correction 
form file . 

When it is not possible to retrieve information 
indicating that the processing target phrase conflicts with 
the stipulations and the like (step S323: No) , the document 

15 review apparatus 10 sets the conflict flag to "0" (step S326) 
and calculates an agreement rate (explained in detail later) 
for the processing target phrase (step S327). Then, the 
document review apparatus 10 determines the sizes of the 
calculated agreement rate and a predetermined specification 

20 value. When the calculated agreement rate is smaller than 
the specified value (step S328: No), the document review 
apparatus 10 calculates various evaluations relating to the 
correction suggestions in the processing target phrase (step 
S329) . The information relating to the processing target 

25 phrase which was extracted in the processing from step S322 
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onwards is stored in a correction required phrase table (step 
S330). Thereafter, the document review apparatus 10 
determines whether all the phrases in the reviewed form have 
been processed . When not all have been processed (stepS331: 
5 No) , the document review apparatus 10 changes the processing 
target phrase to the next phrase (step S332) and returns 
to step S322 to start processing of the new processing target 
phrase . 

Here, the operations of steps S326 to 330 will be 

10 explained more specifically. 

In this invention, average values are obtained by 
adding weights corresponding to a review weight class to 
the numerical values of the information written in the 
responses, and are used as the agreement rate and the various 

15 evaluations. That is, in this invention, numerical values 
at an interval of "1" to "0.2" are allocated to the review 
weight classes "A" to "E". In calculating an evaluation 
value (including the agreement rate) from the values X i/ 
x2/ - ■ - / xn/ which are specified by the reviewers 1, 2, . . . , 

20 n, the evaluation value X is calculated by (cci . xi + oc 2 . 
x2 + . . * + cx n . xn) / (0C1 + a 2 + . . .+ cc n ) using numerical values 
oci, a 2 , . . . , a n , which correspond to the review weight class 
allocated to the reviewer n. 

For example, the calculation of the agreement rate 

25 in step S327 is made by using "100" as an x corresponding 
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to the response showing the correction suggestion for the 
processing target phrase, and "0" as an x corresponding to 
responses (comprising ail responses which deem correction 
to be unnecessary and several responses which deem cor rect ion 
5 to be necessary) not showing any correction suggestions for 
the processing target phrase. A processing target phrase 
which has an agreement rate calculated in this way which 
is greater than a predetermined specified value (e.g. 90) 
is not revised. Therefore, the steps S329 and 330 of 

10 calculating and storing the information using in revision 
are not executed. 

Furthermore, the evaluation value calculated in step 
S329 is divided into information used in selecting one 
correction suggestion from the plurality of correction 

15 suggestions for the processing target phrase in the document 
review apparatus 10, and information used in allowing the 
operator to visually confirm that the selection is correct . 

The former information comprises an agreement 
percentage (weight allocation ratio) for each correction 

20 suggestion for the processing target phrase, and the latter 
information comprises evaluation values (average weight 
allocations) and the like from grammatical, structural, 
logical, and interpretative points of view of the correction 
suggestions . 

25 The specific procedures for using these informations 
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(agreement percentage and evaluation values) will be 
explained later. The agreement percentage is calculated 
by a procedure similar to that in calculating the agreement 
rate. For example, in a case where there are three types 
5 of correction suggestions ( correction suggestions A, B, and 
C) , the agreement percentage for correction suggestion A 
is calculated by using "100" as X for the response showing 
correction suggestion A, and using "0" as X for the response 
showing correction suggestions B and C. The agreement 

10 percentages for correction suggestions B and Care calculated 
by similar procedures. 

Furthermore, evaluation values considering the 
grammar and the like of the correction suggestions are 
calculated by similar procedures. For example, a 

15 grammatical evaluation value for correction suggestion A 
is calculated by using points for grammar and the review 
weight class of each of the responses which the correction 
suggestion A is written in, and a grammatical evaluation 
value for the correction suggestion B is calculated by using 

20 points for grammar and the review weight class of each of 
the responses which the correction suggestion B is written 
in. An evaluation value for the grammar of correction 
suggestion C is calculated by using points for grammar and 
the review weight class of each of the responses which the 

25 correction suggestion C is written in . Structural, logical, 
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and interpretative evaluations of the correction 
suggestions are made by similar calculations. 

Furthermore, responses in which the evaluation points 
for the correction form are between 0 to 20, 21 to 40, 41 
5 to 60, 61 to 80, and 81 to 100 are deemed to be "extremely 
poor", "poor", "normal", "good", and "extremely good" 
responses respectively, and weight allocations of responses 
classified by evaluation are determined for groups of 
responses showing the same correction suggestions. 

10 Then, in step S330, the retrieved correction 

suggestion and the calculated evaluation value are stored 
in correspondence with the processing target phrases, so 
that they can be read immediately when required. More 
specifically, as shown in Fig. 13, the correction required 

15 phrase table enables the category and extracted conflict 
flags of the processing target phrase to be stored in 
correspondence with phrase identifiers, comprising period 
numbers and phrase numbers , for each processing target phrase 
As shown schematically in Fig. 13, the correction required 

20 phrase table enables the evaluation values (the numerical 
values shown inside [] brackets) to be stored for each 
processing target phrase. 

Returning to Fig. 12, the explanation of the operation 
of the document review apparatus 10 will be continued. 

25 When information which shows that the processing 
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target phrase conflicts with the stipulation and the like 
(step S323: Yes) , the document review apparatus 10 sets the 
conflict flag to "1" (step S324) and stores the stipulation 
name, clause number, phrase identifier, and the like, which 
5 are included in the response, in a table of information 
requiring conflict determination (step S325). The table 
of information requiring conflict determination is merely 
a table for storing the contents of the "conflict 
s tipulat ion" boxes of a plurality of responses so that they 

10 do not overlap, and it will not be explained in detail. The 
document review apparatus 10 then shifts to step S329, and 
performs the same process as when the agreement rate was 
below the specified value. 

That is, when a conflict with a stipulation or the 

15 like is indicated, it is preferable to confirm whether there 
actually is a conflict, even is the agreement rate has a 
high value. To achieve this, when a conflict with a 
stipulation or the like is indicated, the document review 
apparatus 10 skips to step S328. 

20 When a conflict with a stipulation or the like is 

indicated but no correction suggestion is shown (a correction 
suggestion for the processing target phrase has not been 
retrieved in step S322) , no evaluation value is calculated 
in step S329. In step S330, the conflict flag in the 

25 correction required phrase table is set to M l" and the data 
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which no correction suggestion are stored in are stored 
(registered) (see Fig. 13). 

When the above processing has been carried out for 
all the phrases which comprise the reviewed form (step S348 : 
5 Yes), the document review apparatus 10 ends the processing 
shown in Fig. 13. Then, the document review apparatus 10 
starts the processing shown in Fig. 14. 

Writing in the flowchart is omitted here, but the 
proces sing shown in Fig. 14 starts when the operator per forms 

10 a predetermined control. That is, when the processing of 
Fig. 12 is complete, the document review apparatus 10 
displays information representing this fact on its own 
display. The operator confirms from the information that 
the collection of the responses is complete, and inputs a 

15 predetermined command. When the input command is detected, 
the document review apparatus 10 starts the processing shown 
in Fig. 14 and deems the first phrase in the correction 
required phrase table to be the processing target phrase 
(step S340) . Then, the document review apparatus 10 

20 determines whether the processing target phrase requires 
a conflict determination, based on the conflict flag stored 
in the correction required phrase table (step S341). 

In the case where the processing target phrase does 
not require a conflict determination (step S341: No), the 

25 document review apparatus 10 displays a screen for reviewed 
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form revision on its display (stepS344) . On the other hand, 
in the case where the processing target phrase requires a 
conflict determination ( step S3 4 1 : Yes) , the document review 
apparatus 10 reads the stipulation name, clause number, and 
5 the like, which are stored in correspondence with the phrase 
identifier of the processing target phrase, from the table 
of information requiring conflict determination (step S342) 
Subsequently, the document review apparatus 10 reads the 
contents of articles and the like relating to items, 

10 identified by an item number or the like, from the server 
or a database relating to the stipulation which has been 
identified by the read stipulation name (step S343) . Then, 
the screen for reviewed form revision is displayed by using 
the information which has been read (step S344). 

15 The screen for reviewed form revision displayed in 

step S344 comprises a screen for phrase revision, which is 
a screen for reviewed form revision displayed in the display 
when step S341 has branch to the NO side, and a screen for 
conflict determination revision, which is a screen for 

20 reviewed form revision displayed in the display when step 
S341 has branch to the YES side. The screen for phrase 
revision and the screen for conflict determination revision 
both have regions called reviewed form revision regions. 
However, the screen for phrase revision also has a region 

25 (a display region of the display other than the reviewed 
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form revision region) which a graph depicting the evaluation 
value is displayed in, whereas the screen for conflict 
determination revision displays contents of the conflict 
article and the like which was read in step S343 in the region 
5 corresponding to the graph display region. 

As shown schematically in Fig. 15, the reviewed form 
revision region comprises several pairs of an original 
display line which shows the phrase breaks in the original, 
and a correction suggestion display line which shows the 

10 corresponding correction suggestions therefor. The size 
of the region can be changed. 

In displaying this reviewed form revision region, the 
document review apparatus 10 extracts information (text 
rows) relating to the form comprising the processing target 

15 phrase from the reviewed form, and displays the information 
on the original display line . The document review apparatus 
10 extracts correction suggestions for a group of phrases 
displayed on the original display line from the correction 
required phrase table. For phrases which have a plurality 

20 of correction suggestions, the correction suggestion having 
the largest calculated agreement percentage is extracted. 
Then, the extract correction suggestions are displayed 
inside the correction suggestion display line below the 
phrases and in positions corresponding thereto. To enable 

25 the operator to confirm the processing target phrases, the 
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document review apparatus 10 displays the processing target 
phrases and their correction suggestions at that point in 
a format different from the other portions (in Fig. 15, the 
processing target phrases are displayed inside double-lined 
5 boxes ) . 

Then, when the screen to be displayed is the screen 
for phrase revision, the graphs which are specified for 
display at that point, for example, the graphs shown in Fig. 

16 and the graph shown in Fig. 17, are displayed in the graph 
10 display region together with the reviewed form revision 

region. 

The round graphs shown in Fig. 16 show the weight 
allocation ratio of the number of responses of the 
evaluations in the case where the evaluation scores from 
15 four points of view, such as grammar and the like, written 
in the responses proposing the correction suggestions for 
the processing target phrase at that point, are classified 
into five evaluations . Furthermore, the graph shown in Fig . 

17 is a round graph showing agreement percentages of 
20 correction suggestions. The correction suggestions 

proposed for the phrase specified by the phrase identifier 
"4-2-8(3)" are "for production" and "for manufacture", and 
the agreement percentage for "for manufacture" is 85%. 

In this way, after displaying the screen for reviewed 
25 form revision in accordance with circumstances , the document 
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review apparatus 10 shifts to standby for a command input 
by the operator (step S345). 

The commands which can be input in this step include 
commands to change the type and number of graphs displayed, 
5 commands to change the displayed correction suggestions, 
and the like. The document review apparatus 10 executes 
processing (stepS346) in compliance with the input command . 
For example, when a change of the displayed correction 
suggestion has been specified, the correction suggestion 

10 for the processing target phrase displayed in the correction 
suggestion display line is changed to another correction 
suggestion which is stored in correspondence with the 
processing target phrase in the correction required phrase 
table. When the document review apparatus 10 is displaying 

15 graphs such as those shown in Fig. 16 (graphs other than 
those which do not require changes when the processing target 
phrases are the same, even when the displayed correction 
suggestions change, {e.g. the graph of Fig . 17 } ) , the display 
contents of the graph are changed to match the newly displayed 

20 correction suggestion. Furthermore, the document review 
apparatus 10 can receive a command to display tables instead 
of graphs, and a command to, display information relating 
to the responder together with the graph or independently 
(the abovementioned evaluation values considering grammar 

25 and the like of the correction suggestions are used in this 
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manner) . Moreover, a function is provided for inputting 
the correction suggestions from a keyboard. In the case 
where no correction suggestions are proposed, the reviewed 
form is revised by using this function . 
5 Then, when a predetermined command has been detected 

(step S345: Next), the document review apparatus 10 
determines that the correction suggestion for the processing 
target phrase which is being displayed at that point is good, 
and performs processing to replace the processing target 

10 phrase of the reviewed form with the displayed correction 
suggestion (step S347) . Subsequently, the document review 
apparatus 10 determines whether all phrases have been 
processed, and when processing is not complete (step S348: 
No) , re-executes the processing from step S341 with the next 

15 phrase in the correction required phrase table as the 
processing target phrase (step S349) . 

The document review apparatus 10 repeats this process , 
and when all the phrases have been processed (step S348: 
Yes) , makes a hyper text version of the reviewed form which 

20 has been processed (step S350) and registers the hyper text 
document in an open server for that document (step S351) . 
The open server may be the document review apparatus 10 itself, 
or another apparatus which is connected thereto by a network . 
Then, the document review apparatus 10 notifies the 

25 departments which requested the review by e-mail that 
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registration is complete, whereby the document review 
processing ends. 

In this way, the document review apparatus 10 according 
to this embodiment has a function for collecting review 
5 results comprising correction suggestions for a reviewed 
form via a network, and a function for statistically 
processing the collected review results, finding the most 
promising correction suggestions, and displaying them to 
the operator. Therefore, when the document review 
10 apparatus 10 is connected to a network, it is capable of 
performing efficient document review with very little 
effort. 

The document review apparatus 10 according to this 
embodiment can be modified in various ways. For example, 

15 the document review apparatus 10 can be modified so as to 
select the first display correction suggestion based not 
on the agreement percentage, but on the size of the evaluation 
value considering the grammar and the like of the correction 
suggestion. Furthermore, the document review apparatus 10 

20 may be modified to transmit the reviewed form when 
transmitting the request mail. However, when there is a 
reviewer who can respond without reading the reviewed form, 
the document review apparatus 10 should preferably be 
configured according to the embodiment described above . 

2 5 This is in order to prevent wasteful use of network resources . 
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Further, although the system (Fig. 1) used in the 
explanation of the document review apparatus 10 uses only 
one document review apparatus 10, a plurality of document 
review apparatuses 10 may of course be connected to the 
5 network. According to such a system constitution, the 
system can efficiently carry out document review in document 
review apparatuses which are provided in distantly separate 
locations . 

10 INDUSTRIAL APPLICABILITY 

As described above, the document review apparatus 
according to this invention can be used to construct a system 
capable of performing efficient document review. 
Furthermore, the document review system according to this 

15 invention can be used for efficient document review in 
general businesses where there are multiple offices in 
distantly separate locations. Moreover, the 

computer-readable recording medium according to this 
invention can be used for realizing such a document review 

20 apparatus in a computer. 



